J 



® 



Europalsches Patentamt 
European Patent Office 
Offic europeen des brevets 





© Publication number : 0 540 445 A1 
EUROPEAN PATENT APPLICATION 



© Application number : 92480145.9 
@ Date of filing : 09.10.92 



©Int. CI. 6 : G06F 3/033 



© Priority : 28.10.91 US 783641 

@ Date of publication of application : 
05.05.93 Bulletin 93/18 

© Designated Contracting States : 
DE PR GB 

© Applicant : INTERNATIONAL BUSINESS 
MACHINES CORPORATION 
Old Orchard Road 
Armonk, N.Y. 10504 (US) 



@ Inventor : Torres, Robert J. 
6100 Meadowhill Drive 
Colleyville, TX 76034 (US) 

© Representative : de Pena, Alain 

Compagnie IBM France Dlpartement de 
Propri6t6 Intellectuelle 
F-06610 La Gaude (FR) 



© Method of representing a set of computer menu selections in a single graphical metaphor. 



© A data processing system includes an operat- 
ing system, a graphical user interface and a 
plurality of applications programs. The graph i- 
ca! user interface generates a window relating 
to an executing application programs. Menu 
items relating to an application program may be 
represented by an icon. A selected group of 
objects is defined over a portion of the menu 
and represented by a metaphor. The graphic 
metaphor, here an icon ring is displayed on a 
display device. The icon ring is evocative of an 
ordered arrangement of items of the selected 
group, includes the icon for a particular object 
open to selection, and is subject to direct mani- 
pulation for reordering of the underlying selec- 
ted group. 
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The invention relates in genera! to a method for 
representing a group of menu items for a data proc- 
essing system In a single graphical m taphor and 
more particularly, methods for enhancing access by 
an operator of the data processing system to each 
menu item available for selection. Still more particu- 
larly, the invention relates to a method for identifying 
a group of objects within a group, defining and order- 
ing of that group, and displaying on a video display 
device a visual metaphor for an arrangement of items, 
indicating that the metaphor does not represent a sin- 
gle object. 

The utility of personal computers has been en- 
hanced in recent years through the use of graphical 
metaphors to represent menu selections on the com- 
puter. Graphical metaphors are graphic constructs 
imaged on a computer display screen. The metaphors 
are images of things of common use with a relation 
to an action to be performed, to an object, or to the 
characteristics of an object defined on the computer. 
For example, a trash can image might be used to rep- 
resent a program for deleting files. A stack of sheets 
of paper might be a metaphor indicating occurrence 
of a word processing document Where an operator 
moves (or drags) the graphical metaphor of the docu- 
ment to the image of the trash can and then selects 
the trash can, the operator deletes the document. In 
effect the operator has constructed the equivalent of 
an operating system command to delete a file. Graph- 
ical metaphors, or "icons" as they are commonly 
called, are to be viewed and manipulated in manners 
analogous to the physical objects which they emu- 
late. 

Icons are generated by graphical user interfaces 
(G.U.I.). A graphical user interface provides direct ma- 
nipulation mechanisms for handling icons, graphics 
for the construction of icons and windows which div- 
ide a display screen into areas in which programs exe- 
cuting concurrently can each display information. Ap- 
plication programs interact with the graphical user in- 
terface to display information in a common format A 
segment of the window can be a name bar which will 
include icons used for the manipulation of the win- 
dow. Another defined space in most windows is the 
menu bar, where required for an application program. 

In most window applications, highlighting an item 
from the menu bar results in generation of what is 
known as a pull-down menu. Where a large number 
of objects are part of the menu, the pull-down window 
or menu can be quite large. The sheer size of the pull- 
down menu may subtract from its convenience and re- 
sult in an operator missing potential options from the 
list Frequently, options are still expressed in highly 
abstract or arbitrary form. The menu items might be 
listed in strings of arbitrary letters and numbers hav- 
ing no clear or conventional meaning. 

It is therefore one object of the present invention 
to represent a group of menu items in terms of a single 



graphical metaphor for that group. 

It is another object of the invention to provide a 
method for enhancing access by an operator to each 
of a plurality of menu Items. 

5 It is still another object of the present invention to 

enhance access by an operator to a plurality of items 
in a menu by providing an icon evocative of an ar- 
rangement of items and permitting direct manipula- 
tion techniques for rearrangement of the group and 

w selection of particular items from the group. 

The foregoing objects are achieved as is now de- 
scribed. A data processing system includes an oper- 
ating system, a graphical user interface and a plurality 
of applications programs. The graphical user inter- 

15 face generates a window relating to an executing ap- 
plication programs. Menu items relating to an applica- 
tion program may be represented by an icon. Aselect- 
ed group of objects is defined over a portion of the 
menu and represented by a metaphor. The graphic 

20 metaphor, here an icon ring is displayed on a display 
device. The icon ring is evocative of an ordered ar- 
rangement of items of the selected group, includes 
the icon for a particular object open to selection, and 
is subject to direct manipulation for reordering of the 

25 underlying selected group. 

The above as well as additional objects, features, 
and advantages of the invention will become appa- 
rent in the following detailed description. 

The novel features believed characteristic of the 

30 invention are set forth in the appended claims. The in- 
vention itself however, as well as a preferred mode of 
use, flirt her objects and advantages thereof, will best 
be understood with reference to the following detailed 
description of an illustrative embodiment when read in 

35 conjunction with the accompanying drawings, where- 
in: 

Figure 1 is a pictorial representation of a personal 
computer system; 

Figure 2 is a diagrammatic representation of soft- 
40 ware organization employed by the personal 

computer system of Figure 1 ; 

Figure 3 is a pictorial representation of a display 

screen including a first opened window; 

Figures 4a-4e are pictorial representations of va- 
45 rious icon ring metaphors for arrangements and 

selections for a group of objects; 

Figure 5 is a logic flowchart illustrating program 

execution on a data processing system of the 

method of the present invention; 
so Figure 6 is a logic flowchart illustrating program 

execution on a data processing system of the 

method of the present invention; 

Figure 7 is a logic flowchart illustrating program 

execution on a data processing system of the 
55 method of the present invention; 

Figure 8 is a logic flowchart illustrating program 

execution on a data processing system of the 

method of the present invention; 
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Figure 9 is a logic flowchart illustrating program 
execution on a data processing system of the 
method of the present inv ntion; and 
Figure 10 is a logic flowchart illustrating program 
execution on a data processing system of the 
method of the present invention. 
Figure 1 depicts a pictorial representation of a 
personal computer system 10 which may be utilized 
in practicing the present invention. Computer system 
1 0 is preferably provided by utilizing an IBM PS/2 per- 
sonal computer 12 or other similar system. Personal 
computer system 10 generally includes a keyboard 
14, a video display device 16 and a mouse 18. Key- 
board 14, video display device 16 and mouse 18 are 
utilized by an operator to provide inputs to personal 
computer system 1 0 and to provide user decenterable 
messages to the operator. Such messages are dis- 
played on video display screen 20 of video device 16. 
Keyboard 14, video display device 16 and mouse 18 
provide the physically manipulate portions of the in- 
terface between personal computer system 10 and 
the human user. 

Figure 2 is a diagrammatic representation of soft- 
ware organization 22 employed in the personal com- 
puter system 10 of Figure 1. A basic input/output sys- 
tem (BIOS) 24 relates to controlling basic hardware 
operations of the computer, particularly the transfer 
of programs, including the operating system, from 
peripheral storage devices such as a hard disk drive 
to addressable computer memory. Upon an operator 
turning on computer 12, BIOS 24 controls a transfer 
of an operating system 26 from peripheral memory to 
addressable memory. A preferred operating system 
for practicing the present invention is the Personal 
System/2 operating system available from Interna- 
tional Business Machines Corporation. The operating 
system of any personal computer controls the execu- 
tion of application programs 32a-32n. A presentation 
layer 28 lies on top of the operating system 26 and be- 
neath the application program 32a-32n. Presentation 
layer 28 is preferably provided by the Presentation 
ManagerTM system available from International Busi- 
ness Machines Corporation. Presentation layer 28 
provides a common syntax for application programs. 
Presentation layer 28 provides such interface ele- 
ments as windows, icons, and graphing capabilities. 
Presentation layer 28 is available to ail application 
programs 32a-32n. Application programs 32a-32n 
provide document processing, (i.e. word processing) 
spreadsheets, games, database manager and such 
other utilities as desired by the operator. 

Figure 3 is a pictorial representation of a display 
image 34 appearing on th display screen 20. Display 
image 34 includes an opened window 36 and a mous 
pointer 38 for selecting and manipulating control ele- 
ments of window 36. Control elements appear in both 
name bar 40, menu bar 42 and scroll bar 43. Below 
menu bar 42 is a text field 44 in which appears a pull- 



down window 46 which is associated with a menu bar 
item. Within pull-down window 46 is an Icon ring 48. 
Icon ring 48 is a visual m taphor for a plurality of se- 
lectabl items relating to the menu Item appearing in 

5 menu bar 42. 

Icon ring 48 is imaged as an arrangement of items 
stacked on one another. The top item of the stack is 
an icon 50 for the current submenu option opened for 
selection. Icon ring 48 is subject to various techniques 

10 of direct manipulation using mouse pointer 38. While 
direct manipulation techniques are known from the 
prior art, the specific application here allows manip- 
ulation of the arrangement of items to peruse the 
available options and to move each option into the top 

15 position of icon ring 48 for possible selection. 

In essence an operator can examine icons for 
particular menu items in a sequential fashion through 
appropriate use of mouse 18. As icons are moved 
from the top of the stack they are replaced in the 

20 stack at the bottom with all other items moving up. 
Icon 50 changes with each replacement of the top- 
most object by imaging the icon for the newly select- 
able object at the top of the stack. The term "menu" 
is used in its broadest sense in this patent, that is as 

25 "a displayed list of objects from which a computer user 
can made a selection or otherwise make inputs." By 
way of example, an icon ring 48 may relate to a group 
of fonts available for selection. Alternatively, an icon 
ring 48 may relate to a group of input fields which may 

30 be accessed. 

Icon ring 48 is also altered with selection of one 
or more options from the submenu represented by 
icon ring 48. Figure 4a depicts a situation where no 
options have been selected. Icon ring 48 includes a 

35 stack or arrangement of items 54 surrounded by a se- 
lection indication border 56. None of items from stack 
54 nor the selection border 56 are highlighted indicat- 
ing no items have been selected. 

Figure 4b depicts the situation where icon ring 48 

40 has been selected. The ring boundary bar 56 has 
been highlighted, while stack 54 remains unchanged. 
Selection of icon ring 48 opens stack 54 to manipula- 
tion. 

Figure 4c depicts in pictorial form a situation 
45 where icon ring 48 is selected and one option from 
stack 54 has been selected. Boundary 56 remains 
highlighted and one item from stack 54, represented 
by the icon on top of the stack, is highlighted to indh 
cate selection of the item. 
50 A selected item need not be the item on top of 
stack 54. Figure 4d depicts a situation where two op- 
tions have been selected while the icon ring itself re- 
mains selected. Highlighting of items within stack 54 
and boundary 56 indicates this status. 
55 In Figure 4e icon ring 48 has been deselected as 

indicated by the removing of highlighting from bound- 
ary 56. No change in the status of items within stack 
54 has been made from Figure 4d and accordingly se- 
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lect d options remain highlighted. 

Ref rring now to Figures 5-10, there are depicted 
logic flowcharts illustrating icon ring presentation and 
manipulation methods of the present invention. The 
process begins at start block 60 indicating a power up 
situation on a personal computer. Next, at operation 
block 62, the data processing system is initialized. Ini- 
tialization includes transfer of an operating system 
and presentation layer from peripheral memory to ad- 
dressable memory within computer system 10. Next, 
at block 64, selected windows, icons and applications 
are opened indicating their display for selection on 
the video display device 16. Next, at block 66, the 
computer renders a hold to monitor for user inputs 
through keyboard 14 or manipulation of mouse 18. 

Upon receipt of a user input, computer 12 under- 
takes analysis to determine the nature of that selec- 
tion. At block 68, the computer determines if an icon 
ring has been selected. The YES decision branch 
from block 68 directs execution to a SELECT routine 
through block 70. The NO decision branch from block 
68 advances execution to a decision block 72 which 
relates to manipulation of an icon ring, (f selection 
within a ring is to be advanced, the YES branch from 
decision block 72 is followed to the ADVANCE routine 
indicated at block 74. The NO branch from decision 
block 72 advances execution to decision block 76. At 
block 76 is determined whether a menu item has been 
selected from the icon ring. The YES branch advanc- 
es to option block 78 for execution of an OPTION rou- 
tine. The NO decision branch advances execution to 
decision block 80 which determines whether a sec- 
ond selection has been made from the menu. The 
YES decision branch advances execution to a MUL- 
TIPLE SELECTION routine indicated at block 82. The 
NO decision branch advances execution to decision 
block 82. Decision block 82 relates to use of certain 
direct manipulation techniques provided by the pre- 
sentation layer. At block 82 it is determined whether 
the user wishes to move the icon ring. AYES branch 
from decision block 82 moves execution to a DRAG 
subroutine 64 while a NO decision branch returns pro- 
gram execution to a monitor status by way of the 
other operations block 86. 

The various subroutines are accessed from the 
main routine of Figure 5. In each of the figures a circle 
containing the letter A indicates the route by which 
execution returns to the main program of Figure 5. 

SELECT routine 70 relates to the opening and 
closing an icon ring for manipulation. This is depicted 
visually to the user by the highlighting of a boundary 
surrounding the stack of items. At block 88 it is deter- 
mined if the icon ring has been select d. Th YES 
branch of decision block 88 is taken if the icon ring 
was already open. Selection emphasis on the ring is 
removed at block 90 and all options highlighted within 
the stack are preserved at block 92. Program ex cu- 
tion is the returned to the main program in Figure 5. 



The NO branch from decision block 88 advances exe- 
cution to block 94, where emphasis is added to the 
boundary around the stack in the icon ring. Next all 
options retain emphasis that they might have had 

5 upon entry to the ring at block 92. Again operation is 
returned to the main program from block 92. 

Figure 7 illustrates manipulation of the arrange- 
ment of elements within a icon ring stack. Execution 
begins at advance block 74 and proceeds to decision 

10 block 94 where the character of the operator input is 
examined. The example given here is for use of a 
mouse for manipulation of the icon ring. At decision 
block 94 is determined whether the operator has 
made a quick depression and release of a selection 

15 button on the mouse with the mouse pointer adjacent 
to the image of the icon ring. Execution advances 
along the YES branch from decision block 94 to op- 
eration blocks 96 and 98 which operate on the icon 
ring stack to remove the top, opened item from the 

20 stack to the bottom of the stack and to advance the 
following item to the open or select position on top of 
the stack. Program execution is returned to the main 
program at letter A. The NO branch from decision 
block 94 advances to the press and hold determina- 

25 tion of decision block 100. The YES branch from de- 
cision block 100 advances execution to operation 
blocks 102 and 104 which initiate a cycle through all 
items in the stack by repeated return of operation to 
the press and hold decision block 100. In other words, 

30 as long as the mouse select button is held down, the 
stack of items for selection is scrolled. The NO deci- 
sion branch from the press and hold decision block re- 
turns operation of the program to the main program 
at letter A. 

35 Figure 8 illustrates selection of an option from 

among the items in an icon ring stack. From block 78, 
execution advances to decision block 106 where it is 
determined if the option has previously been select- 
ed. If the option has not been previously selected it is 

40 assumed the operator now intends to select it and the 
YES branch is followed from decision block 106. Se- 
lection emphasis for the icon for the option is then 
added at block 108 and the program is returned to the 
main program through letter A. If the option had al- 

45 ready been highlighted as selected, it is assumed the 
operator now wishes to deselect the option and the 
NO branch from decision block 106 is followed. At 
block 110 selection emphasis is removed from the op- 
tion and the item is deselected. Execution then re- 

50 turns to the main program through letter A. 

Figure 9 depicts a logical flow diagram relating to 
execution of the program upon selection of a second 
or other multiple option from the menu. From block 
82, decision block 111 is executed to determin 

55 whether multiple selections are permitted. If not, the 
OPTION subroutine is executed through block 78. If 
multipl selections are permitted, block 112 is next 
executed to add selection emphasis to the top icon of 
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an icon ring stack. Next, at block 114, the selection 
emphasis on all other icon ring items is refreshed. 
Next, at block 116, the entire display is updated for im- 
aging on a video display device and program execu- 
tion is returned to in program through letter A. 

Figure 10 relates to the drag option, i.e., the di- 
rect manipulation of items of an icon ring. From entry 
into the drag routine at block 84, operation of block 
118 follows. At block 118, it is determined whether 
pointer location is on the icon ring. Next, at block 120, 
it is determined if a selection exists. Along the YES 
branch from decision block 120 the item or token for 
the selected item is a^ached to the mouse pointer. At 
this point, the user or operator may move the token 
around on a video display screen. Along the NO 
branch from decision block 120, an open, i.e. nonse- 
lected option token is attached to the pointer for 
movement across the screen at block 124. Operation 
from blocks 122 and 124 merge then at block 126 for 
monitoring of further user inputs. User inputs could in- 
clude movement, as already described, as well as the 
drop option which relates to detaching a token for an 
item from the mouse pointer. Until the drop option is 
selected, user inputs will simply result in a continued 
cycling of the program through blocks 126 and deci- 
sion block 128. Block 128 relates to determination of 
the drop selection having been made. The YES 
branch from block 128 advances execution to block 
130 where a token is removed from the pointer and 
from there to block 132 relating to performance of 
some action resulting from the new position of the 
token for the item. From block 132 execution is re- 
turned to the main program through letter A. 

For a large number of choices in a selection list, 
the present invention can avoid requiring a designer 
segmenting data into hierarchical chains. Users or op- 
erators to the system will not require extra time to 
learn the structures of these chains preserving ease 
of use of the underlying window system. 



Claims 

1 . A method of enhancing display of a plurality of ob- 
jects from a menu for a data processing system, 
the method comprising: 

associating an icon with each object from 
the menu; 

defining an ordered group of objects from 
the plurality of objects in the menu; and 

displaying, on a video display device, an 
icon ring for the ordered group of objects, the icon 
ring being a visual metaphor of an ordered ar- 
rangement and including the icon for a particular 
object from the ordered group of objects open for 
selection. 

2. A method of enhancing display of a plurality of ob- 



jects from a menu for a data processing system, 
as set forth In Claim 1 and further comprising: 

reordering, upon operator selection, the 
group of objects to pr s nt a particular object 

5 open to selection; and 

displaying, on the video display device, an 
icon ring for the reordered group of objects, the 
icon ring being a visual metaphor of an ordered 
arrangement of items and including the icon for 

10 the particular object opened for selection. 

3. Amethod of enhancing display of a plurality of ob- 
jects from a menu for a data processing system 
as set forth in Claim 2, the method further com- 

15 prising: highlighting an icon for an object upon se- 
lection of the object. 

4. Amethod of enhancing display of a plurality of ob- 
jects from a menu for a data processing system 

20 as set forth in Claim 3, the method further com- 
prising: 

altering a visual aspect of an icon ring to in- 
dicate a selected object, wherein the icon for the 
selected object has been suppressed upon reor- 
25 dering the group of objects. 

5. Amethod of enhancing display of a plurality of ob- 
jects from a menu for a data processing system 
as set forth in Claim 4, the method further com- 

30 prising: 

altering a second visual aspect of the icon 
ring to indicate a plurality of selected objects. 

6. Amethod of enhancing display of a plurality of ob- 
35 jects from a menu for a data processing system 

as set forth in Claim 2, wherein the visual meta- 
phor for an ordered group of items appears as a 
skewed stack with the icon for the particular ot>- 
ject opened for selection being on top of the 
40 stack. 

7. Amethod of enhancing display of a plurality of ob- 
jects from a menu for a data processing system 
as set forth in Claim 2, wherein an icon ring is an 

45 appropriate subject of direct manipulation 
through a graphical user Interface. 

8. A data processing system for providing display of 
objects from a menu for the data processing sys- 

50 tern, the data processing system comprising: 

means for associating an icon with each 
object from the menu; 

means for ordering a group of objects from 
the plurality of objects from the menu and thereby 
55 presenting a first object for operator selection; 

and 

means for displaying an icon ring for the 
ordered group of objects, the icon ring being a 
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visual metaphor of an arrangem nt of items and 
including th icon for the first object from the or- 
dered group of obj cts open for operator selec- 
tion. 

5 

9. A data processing system for providing display of 
objects in a menu for the data processing system 
as set forth in Claim 8, the data processing sys- 
tem further comprising: 

means responsive to user selection for re- 10 
ordering the group of objects to present a second 
object open to selection; and 

means for displaying an icon ring for the 
reordered group of objects, the icon ring being a 
visual metaphor of an arrangement of items and 15 
including the icon for the second object open to 
selection. 

10. A data processing system for providing display of 
objects in a menu for the data processing system 20 
as set forth in Claim 9, the data processing sys- 
tem further comprising: 

means for highlighting the icon for an ob- 
ject upon selection of the object 

25 

11. A data processing system for providing display of 
objects in a menu for the data processing system 
as set forth in Claim 9, the data processing sys- 
tem further comprising: 

means for altering a visual aspect of an 30 
icon ring to indicate status of an object included 
in the group of objects represented by the icon 
ring as a selected object, wherein the group of ob- 
jects has been reordered to close the selected 
object from further selection. 35 

1 2. A data processing system for providing display of 
objects in a menu for the data processing system 
as set forth in Claim 11, and further comprising: 

means for altering a second visual aspect 40 
of the icon ring to indicate a plurality of selected 
objects. 

13. A data processing system for providing display of 
objects in a menu for the data processing system 45 
as set forth in Claim 9, wherein the visual meta- 
phor for the arrangement of items is a skewed 
stack of items including the icon for a present ob- 
ject opened to selection in a position atop the 
stack. so 

14. A data processing system for providing display of 
objects in a menu for the data processing system 
as set forth in Claim 9, and further comprising: 

means responsive to user selection for di- 55 
rectly manipulating an icon ring, the direct manip- 
ulation means including a graphical user inter- 
face. 
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